Music search system and music search apparatus

ABSTRACT

A time-series signal input section  205  inputs a time-series signal whose on state and off state are repeated alternately. A similar rhythm search section  206  searches a plurality of pieces of rhythm data stored in a data storage section for rhythm data having the same fluctuation pattern as or a similar fluctuation pattern to the time-series signal input to the time-series signal input section  205 . A music-associated information storage section  204  stores music-associated information associated with the piece of music corresponding to the rhythm data in association with the rhythm data. A search result generation section  207  generates the search result using the music-associated information (information of title, etc.,) stored in association with the found rhythm data and outputs the search result through a search result output section  208.

RELATED APPLICATIONS

The present disclosure relates to the subject matter contained inJapanese Patent Application No. 2004-288433 filed on Sep. 30, 2004,which is incorporated herein by reference in its entirety.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to a music search system and apparatus forsearching for music, a musical piece, a song, etc.

2. Description of the Related Art

As a music search method in a related art, a method of enteringinformation associated with music, such as a title or a performer(artist), as a character string and searching for it is generally known.

In addition, as a method of searching for music or informationconcerning music (for example, artist of performer, etc.,), thefollowing search methods based on input are known:

(1) A mobile telephone is held to the sound source of music produced inthe surrounding of a searcher and the sound is input to an apparatus.(2) Voice waveform of hummed tune is input.(3) A search is made for music based on performance information of akeyboard instrument, etc.(4) A scale string representing syllable names in a character string,such as do re mi fa, is input for searching for music.(5) A chord progression of music (series of harmony of C, G7, etc.,) isinput for searching for music containing the chord progression.

The music search methods in the related arts are characterized by thefact that any of at least timbre, melody, or harmony among rhythm,timbre, melody, and harmony of components of music is input.

In contrast, a method of playing back sound by inputting a time-seriessignal, namely, rhythm only is proposed in JP-A-2003-142511. A similarmethods are disclosed in the following documents:

-   -   Naoki Iketani, Masanori Hattori, Akihiko Oosuga: “Rhythm        inputting interface “Ta-ta-ta-tap”,” Jyouhoushori gakkai        dai66kai zen'kokutaikai 4A-4, 2004    -   Haruto Takeda, Kouichi Shinoda, Shigeki Sagayama, et al.:        “Rhythm recognition using Rhythm vector,” Jyouhoushori gakkai        ken'kyuu houkoku    -   “On'gaku jyouhou kagaku” No. 46,2002

A data searching method by inputting a time-series signal, namely,rhythm only is proposed in JP-A-2004-033492.

SUMMARY OF THE INVENTION

However, in the music search method based on input of a time-seriessignal in the documents described above, the rhythm identifying methodis not refined and the music search method lacks effective components tomake the most of the method as a music search method.

The conventional methods also lack effective components to implement themethod as a search method for ringer music in a mobile telephone.

It is therefore one of objects of the invention to make a music searchapparatus based on rhythm input easier to use and easier to implement.

According to a first aspect of the invention, there is provided a musicsearch system including: a music search apparatus; and a music searchterminal, wherein the music search apparatus includes: an input unitthat inputs a time-series signal represented by on/off signals; a datastorage unit that stores a plurality of pieces of rhythm data inassociation with music-associated information associated with musiccorresponding to the rhythm data; a search unit that searches theplurality of pieces of rhythm data stored in the data storage unit forrhythm data having the same fluctuation pattern as or a similarfluctuation pattern to the time-series signal input to the input unit;and a search result output unit that reads the music-associatedinformation stored in association with the rhythm data found by thesearch unit from the data storage unit and outputs the readmusic-associated information as the search result of the search, whereinthe music search terminal includes: a communication unit thatcommunicates with the music search apparatus via: a communication line;a operation unit that inputs the time-series signal to the input unitthrough the communication unit; a receiving unit that receives thesearch result of the input time-series signal through the communicationunit from the search result output unit; and a display unit thatdisplays the received search result.

According to a second aspect of the invention, there is provided a musicsearch apparatus including: an input unit that inputs a time-seriessignal represented by on/off signals; a data storage unit that stores aplurality of pieces of rhythm data in association with music-associatedinformation associated with music corresponding to the rhythm data; asearch unit that searches the plurality of pieces of rhythm data storedin the data storage unit for rhythm data having the same fluctuationpattern as or a similar fluctuation pattern to the time-series signalinput to the input unit; and a search result output unit that reads themusic-associated information stored in association with the rhythm datafound by the search unit from the data storage unit and outputs the readmusic-associated information as the search result of the search.

According to a third aspect of the invention, there is provided a musicsearch method including: inputting a time-series signal represented byon/off signals; storing a plurality of pieces of rhythm data inassociation with music-associated information associated with musiccorresponding to the rhythm data; searching the plurality of pieces ofrhythm data for rhythm data having the same fluctuation pattern as or asimilar fluctuation pattern to the time-series signal; reading themusic-associated information found by the search; and outputting theread music-associated information as the search result of the search.

According to a fourth aspect of the invention, there is provided acomputer-readable program product for causing a computer system toexecute procedures for searching a music, including: inputting atime-series signal represented by on/off signals; storing a plurality ofpieces of rhythm data in association with music-associated informationassociated with music corresponding to the rhythm data; searching theplurality of pieces of rhythm data for rhythm data having the samefluctuation pattern as or a similar fluctuation pattern to thetime-series signal; reading the music-associated information found bythe search; and outputting the read music-associated information as thesearch result of the search.

BRIEF DESCRIPTION OF THE DRAWINGS

The above objects and advantages of the present invention will becomemore apparent by describing in detail exemplary embodiments thereof withreference to the accompanying drawings, wherein:

FIG. 1 is a drawing to show the configuration of a music searchapparatus based on rhythm input according to an embodiment of theinvention;

FIG. 2 is a function block diagram to show the configuration of a musicsearch apparatus based on rhythm input according to the embodiment;

FIG. 3 is a flowchart to describe the mobile telephone operation and thesearch apparatus operation;

FIG. 4 is a drawing to show a composition example of data stored in arhythm data storage section 201;

FIG. 5 is a flowchart to show a processing flow of rhythm datageneration;

FIG. 6 is a drawing to show a composition example of data stored in arhythm data storage section 203;

FIG. 7 is a flowchart to show a processing flow of similar rhythm searchconducted by a similar rhythm search section 206;

FIG. 8 is a drawing to describe a procedure of converting an inputtime-series signal train into rhythm data;

FIG. 9 is a drawing to show an example of the similar rhythm searchresult;

FIG. 10 is a drawing to show an example of information relevant toringer tone stored in a music-associated information storage section204;

FIG. 11 is a drawing to show an example of the finally output searchresult;

FIG. 12 is a flowchart to describe two-stage search; and

FIG. 13 is a block diagram to show the configuration when the musicsearch apparatus according to the embodiment of the invention isimplemented in a computer.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Referring now to the accompanying drawings, a description will be givenin detail of embodiments of the invention.

First Embodiment

FIG. 1 is a drawing to show the configuration of a music searchterminal, such as a mobile telephone, based on rhythm input according toan embodiment of the invention. In the embodiment, by way of example, amusic search terminal 101 of mobile telephone type is included.

The embodiment typically is implemented as a computer controlled bysoftware. The software in this case includes a program and data, thefunctions and effects of the invention are provided by making the mostof computer hardware physically, and appropriate related arts areapplied to portions where the related arts can be applied. Further, thespecific types and configurations of hardware and software for embodyingthe invention, the software processing range, and the like can bechanged as desired. Therefore, in the description that follows, avirtual function block diagram indicating the component functions of theinvention as blocks is used. A program for operating a computer toembody the invention is also one form of the invention.

FIG. 2 is a function block diagram to show the configuration of a musicsearch apparatus based on rhythm input according to the embodiment ofthe invention.

First, an outline of each function, block will be discussed before thedetailed description of the embodiment.

In FIG. 2, a music data storage section 201 has a function of storingmusic data to search for in the format of ringer melody in “.mmf”format, ringer melody in SMAF format, a kind of ringer music, MIDIformat; “Chaku-uta (registered trademark in Japan)” format of audiodata, linear PCM code audio format, MPEG1 AUDIO Layer 3 format, etc. Themusic data storage section 201 is implemented as a record medium such asmemory or a hard disk, for example.

A rhythm data generation section 202 receives music data input from themusic data storage section 201 and further input of edit data of arhythm data editor as required and generates rhythm data fitted to eachpiece of music, used as a search key in searching for music for eachpiece of music and then registers the rhythm data in a rhythm datastorage section 203. The rhythm data fitted to each piece of music isdata formed as rhythm assumed to be entered by the user in searching forthe piece of music or a rhythm group containing the rhythm; generallythe rhythm of the beginning portion, the characteristic portion, and thetheme of music becomes rhythm data for input music. That is, the rhythmdata generation section 202 generally generates the rhythm data of thebeginning, the characteristic portion, the theme, etc., of input musicdata as registered rhythm data.

The theme is not necessarily the fitted rhythm. Thus, rhythm data may becreated for each of a plurality of parts contained in MIDI data.

To generate MIDI data from a WAVE file of linear PCM code audio format,a spectrum analysis of audio is conducted and mechanical conversion maybe executed, for example, using “MuseBook® Wav2Midi Version 1.0, orusing a technique employed in a computer software called“Saifunotatsujin”. Alternatively, it is also possible to generate rhythmdata directly from the WAVE file or the MPEG1 AUDIO Layer 3 formatdepending on music data. For example, if music involves vocals, thevocal signal is extracted through an analog filter for performing signalprocessing of narrowing down to the voice frequency band; further, inmusic data of stereo audio, using the fact that the vocal part is fixedat the center and a chorus and other instrumental sounds are fixed atthe left and right other than the center, the vocal signal can beextracted more precisely. For the vocal signal thus extracted, theportion where the sound volume or the sound volume change rate is highis assumed to be vocalization and the time is recorded, whereby songrhythm can be generated.

Further, to automatically generate rhythm data from music data, a knownart of detecting the time of a characteristic portion is used together,whereby the rhythm data of the characteristic portion assumed to beentered by the user can be generated with high accuracy. Thecharacteristic portion detection technology is described in thefollowing document: “Masataka Gotou: “Real time musical scenedescription system: Sabikukan ken'shutsushuhou,” Jyouhoushori gakkaiOn'gakujyouhoukagaku ken'kyuukai ken'kyuu houkoku 2002-MUS-47-6, Vol.2002, No. 100, pp. 27-34, October 2002.”

A rhythm data storage section 203 retains the rhythm data generated bythe rhythm data generation section 202 and provides the rhythm data fora similar rhythm search section 206. The rhythm data storage section 203is implemented as memory in a computer, for example.

A time-series signal input section 205 inputs a music rhythm signalinput by a music searcher as a search key for searching for music (inputtime-series signal) and outputs the input signal to the similar rhythmsearch section 206 as input time-series signal. The time-series signalinput section 205 may have a function capable of detecting time changeof ON/OFF and can be implemented as any of various machines such as notonly various keys and buttons of a keyboard of a personal computer (PC),a mouse, buttons of a mobile telephone, and buttons of a remote control,but also a touch panel and an infrared sensor.

The similar rhythm search section 206 inputs the input time-seriessignal input from the time-series signal input section 205 and therhythm data retained in the rhythm data storage section 203, searchesfor rhythm data similar to the signal pattern of the input time-seriessignal, and outputs the search result to a search result generationsection 207.

A music-associated information storage section 204 is a section forretaining titles, composer names, songwriters, performer names, a partor all of words, URL where music data exists, music data, etc.,associated with music in association with the music data, and isimplemented as memory in a computer, for example.

The music-associated information storage section 204 may further retainsyllable names, score data, words, or sound data associated with music.

The search result generation section 207 inputs the search result of thesimilar rhythm search section 206, references the music-associatedinformation from the music-associated information storage section 204 inresponse to the search result as required, and generates output data foroutputting the search result to the music searcher. For example, fromthe search result of the similar rhythm search section 206, as relevantinformation to the found rhythm data, the title, the composer name, thesongwriter, the performer name, a part or all of words, the URL wherethe music data corresponding to the rhythm data exists, the music data,and the like are output as a set to a search result output section 208as output data.

The search result output section 208 outputs the output data generatedby the search result generation section 207 to the searcher. Forexample, the data is output as screen information or sound informationwith the mobile telephone used for the search.

Next, the case implemented as a ringer tone search apparatus for themobile telephone user as the most typical embodiment will be discussedcontaining the specific configurations of the function blocks.Throughout the specification, the mobile telephone may be any type ofmobile telephone including PHS, a mobile telephone involved in radio LANcommunications, etc.

Throughout the specification, the ringer tone refers to a sound producedto inform the mobile telephone user that a telephone call or mail comesin the mobile telephone, and contains not only a musical piece, but alsoa voice only.

Operation of Mobile Telephone

The operation of mobile telephone is executed according to a procedureshown in FIG. 3.

(Step S301) Mobile telephone 101 transmits an input time-series signalto search apparatus via a radio communication line. To input the inputtime-series signal, for example, rhythm is input using one button of themobile telephone and the input time-series signal is transmitted to thesearch apparatus in sequence.

(Step S302) The mobile telephone 101 receives the search result from thesearch apparatus via the radio communication line and outputs the searchresult to a display 102 or a speaker 111 of the mobile telephone 101.

(Step S303) To terminate the ringer tone search processing, the mobiletelephone 101 goes to step S304; to continue the ringer tone searchprocessing, the mobile telephone 101 returns to step S301.

(Step S304) The mobile telephone 101 sends a search processingtermination notification to the search apparatus via the radiocommunication line and terminates the processing.

Operation of Search Apparatus

The operation of the search apparatus is executed according to aprocedure shown in FIG. 3.

(Step S351) The search apparatus receives the input time-series signalinput in sequence from the mobile telephone via the radio communicationline, passes the input time-series signal to the similar rhythm searchsection 206 in sequence, and makes a search request for searching forrhythm data similar to the input time-series signal.

(Step S352) The search apparatus executes search in sequence with thepassage of time and outputs the search result produced usingmusic-associated information related to the found rhythm data to themobile telephone via the radio communication line. In the example, it isassumed that the title and the performer name among the title, thecomposer name, the songwriter, the performer name, a part or all ofwords, the URL where the music data exists, and the music data are usedas the music-associated information.

(Step S353) To continue the search, the search apparatus returns to stepS351; to terminate the search, the processing is terminated.

Thus, the user of the mobile telephone continues to input rhythm withone button of the mobile telephone, whereby the search apparatussearches the rhythm data storage section 203 in sequence for the rhythmdata having rhythm similar to the input time-series signal and transmitsthe rhythm data to the mobile telephone.

Consequently, with the mobile telephone, the music searcher can obtainin sequence the search result of playing back the possible ringer toneto be found, seeing the title of the ringer tone, etc.

If the music-associated information storage section 204 can also retainthe syllable names, the score data, the words, or the sound dataassociated with the piece of music, the music searcher can also checkthem as the search result.

In the example, the input time-series signal is transmitted in sequencefrom the mobile telephone to the search apparatus, which then executessearch in sequence. However, the invention is not limited to it. Searchmay be executed with input of a search execution button pressed on themobile telephone as a trigger. In this case, for example, the musicsearcher using the mobile telephone 101 inputs the input time-seriessignal for a given time and then presses the search execution button fortransmitting the input time-series signal for the given time to thesearch apparatus. With pressing the search execution button as atrigger, the search apparatus may search the rhythm data storage section203 for the rhythm data having rhythm similar to the input time-seriessignal and may transmit the rhythm data to the mobile telephone. In thiscase, the mobile telephone needs to have a function for acquiring theinput time-series signal.

As the search result, ringer tone data or data to acquire ringer tone(link information with ringer tone data, ringer tone, or the like) istransmitted to the mobile telephone, whereby the user of the mobiletelephone can download any desired ringer tone from the search result.

The search apparatus will be discussed below in detail for each functionblock:

The data stored in the music data storage section 201 is data forenabling music to be played back using a computer; for example, itincludes data in SMAF (Synthetic music Mobile Application Format)represented by extension “.mmf,” a typical data format of ringer melody,and data in SMF (Standard Midi File) format represented by extension“.mid,” a more general MIDI standard format, as shown in FIG. 4. Inaddition, the data covers general music data, such as ringer melody dataknown as extension “.pmd,” Chaku-uta (registered trademark in Japan)having extension “.amc,” etc., data with extension “.wav” called WAVEformat, and data with extension “.mp3” in AUDIO Layer 3 format. In themusic data storage section 201, the music data is stored in associationwith music data ID. Here, the music data ID is called CID. The musicdata storage section 201 can be implemented as a record medium such asmemory or hard disk in a server computer.

Next, the rhythm data generation section 202 inputs music data from themusic data storage section 201 and generates rhythm data fitted to eachpiece of music for each piece of music. As a typical example, a methodof inputting music data in the SMF format and generating rhythm data isshown. Briefly, music data in the MIDI format including SMF is likedigital data of score information and is made up of tempo of music andtimbre, duration, pitch, etc., of separate sound. The rhythm datageneration section 202 excludes the timbre information and the pitchinformation from the data, extracts the duration information, andconverts it into data.

A processing flow of the rhythm data generation will be discussed withFIG. 5.

(Step S501) MIDI data file in the SMF format is read together with theCID from the music data storage section 201.

(Step S502) If a plurality of tracks exist in the MIDI data, one trackis selected according to assistance input of the operator.

(Step S503) Time information (delta time) where sound rising informationin the selected track (note on message) occurs is cut out and soundinterval information is added to an array as a numeric string. This stepis repeated and the sound interval information string for the wholemusic data is retained.

(Step S504) For the sound interval information string, one or moreportions used as rhythm data are selected according to assistance inputof the operator.

(Step S505) One or more pieces of sound interval information selected atstep S504 are output to the rhythm data storage section 203 as therhythm data in association with the CID.

The processing section described above may be accomplished using any ofvarious known GUI functions in related arts.

In the embodiment, as the rhythm data, the time interval string ofkeying is indicated, separated by a comma in millisecond units, andrhythm data r is represented as follows:

r={r1, r2, r3, . . . , rn}

For example, if the rhythm is made up of four times of keying of “ta, _,ta, ta, ta” (where _denotes a one-beat rest symbol), there are threekeying intervals. Thus, for example, assuming that one beat is 250milliseconds, the rhythm data r is represented as r={500, 250, 250}. Inthe embodiment, the rhythm data generation section 202 is implemented asa CPU and a program of a server computer.

The rhythm data storage section 203 is a function block for retainingthe rhythm data in association with the identifier; typically, it isimplemented as storage of a computer. In the embodiment, the rhythm datastorage section 203 is constructed as memory or a hard disk of a servercomputer and memory of a mobile telephone.

The rhythm data storage section 203 retains not only the rhythm datagenerated and output in the rhythm data generation section 202, but alsothe rhythm data created outside the search apparatus and the rhythm datamanually entered by the user.

FIG. 6 shows a composition example of the data stored in the rhythm datastorage section 203. The rhythm data storage section 203 stores the CIDof the music data ID and the rhythm data in association with each other.

The time-series signal input section 205 outputs the time change ofON/OFF entered by the enterer to the similar rhythm search section 206as an input time-series signal train.

The time-series signal input section 205 is an input unit that candetect at least one or more ON/OFF states; typically it is implementedas a button of a mechanical part involving electronic output. In theembodiment, it is a part of the mobile telephone of the searcher. Thebutton and the circuit for receiving the button signal correspond to thetime-series signal input section 205. The time-series signal inputsection 205 can be implemented not only as the mobile telephone, butalso as a keyboard, a mouse, etc., of PC, a touch panel, a remotecontrol button, etc., if it can detect the ON/OFF state, as describedabove.

The similar rhythm search section 206 inputs the input time-seriessignal train, selects rhythm data similar to the fluctuation pattern ofthe signal, and outputs the similarity degree between one or morecandidates and input patterns as a set to the search result generationsection 207.

In the embodiment, the similar rhythm search section 206 is implementedas a server computer and a CPU and a program of a mobile telephone.Typically, it is implemented as a program of a computer for convertingthe input signal train into rhythm data and then performing calculationusing an algorithm for calculating the similarity between two rhythms.

An example of a processing flow of similar rhythm search conducted bythe similar rhythm search section 206 will be discussed with FIG. 7.

(Step S701) The similar rhythm search section 206 receives the inputtime-series signal from the time-series signal input section 205 andconverts the input time-series signal into input rhythm data.

(Step S702) One piece of rhythm data is taken out from the rhythm datastorage section 203 and the similarity between the rhythm data and theinput rhythm data is calculated based on a similarity determinationalgorithm.

(Step S703) If the similarity is not calculated for all rhythm data, theprocess returns to step S701 and the processing is repeated; if thesimilarity is calculated for all rhythm data, the process goes to stepS704.

(Step S704) The CIDs and the similarity degrees s for the threehigh-order pieces of rhythm data in the descending order of the rhythmsimilarity of the calculation result are output to the search resultgeneration section 207 and the processing is terminated.

In the embodiment, the procedure of converting the input time-seriessignal train into the rhythm data is an easy procedure according towhich the time at which the OFF-to-ON state transition is made isdetected, each time interval is described in millisecond units, and thetime interval string is converted into data separated by a comma, asshown in FIG. 8.

As the algorithm for determining the similarity between two pieces ofrhythm data, a calculation method according to a rhythm vector techniquein non-patent documents 1 and 2, a similarity degree calculation methodaccording to the differential square sum, a similarity degreecalculation method using dynamic programming, etc., can be used. In theembodiment, the similarity degree calculation method according to thedifferential square sum technique is adopted, and the calculation methodwill be discussed below:

Let the input rhythm data into which the input time-series signal trainis converted be R_(i) and the rhythm data acquired from the rhythm datastorage section 203 be R_(j).

R_(i)={r_(i1), r_(i2), r_(i3), . . . , r_(in)}

R_(j)={r_(j1), r_(j2), r_(j3), . . . , r_(jn), . . . , r_(jm)}

Distance d between the two rhythms is calculated as follows:

d=Σ _(k)((r _(ik) −r _(jk))²)

The similarity degree s is calculated as follows:

s=1/(1+d)

The larger the similarity degree s, the higher the similarity. Forexample, a pair of the CID and the similarity s for each of the threehigh-order pieces of rhythm data R_(j) in the descending order of thevalue of s is output to the search result generation section 207.

In the embodiment, the similar rhythm search result as shown in FIG. 9is output as the result of the calculation. FIG. 9 shows that the CID ofthe music data with the highest similarity degree is “MUS0003” and thesimilarity degree is “0.8.”

The music-associated information storage section 204 is a function blockfor retaining information relevant to ringer tone and retainingassociated information of the title, composer name, etc., for example,with the identifier for identifying the ringer tone as a key. Themusic-associated information storage section 204 is implemented asmemory of a computer, etc.

In the embodiment, the music-associated information storage section 204retains data of “title,” “music genre,” “composer name,” “songwritername,” and “URL where music data exists” with the CID of the musicidentifier as a key, as shown in FIG. 10. The invention is not limitedto the format; for example, all information relevant to music and itsdata, such as the performer name, the album name, the music play time,the data size of ringer tone data, a part or all of words, and theringer tone data, can be stored.

The search result generation section 207 receives the pairs of the CIDsand the similarity degrees s input from the similar rhythm searchsection 206, organizes them as output data in the search result outputsection 208, and outputs the organized output data to the search resultoutput section 208. At the organizing time, any other information whichneeds to be output as the search result is acquired from themusic-associated information storage section 204 based on the CID. Theoutput data is made up of text information, image information, soundinformation, the score of the similarity degree, etc.

To output the similarity degree, the similarity degree may be normalizedso that 0 points mean complete non-similarity and 100 points meancomplete match as the score based on the similarity degree s.Accordingly, it is made possible for the searcher to see how much theresult matches the input at a glance.

The search result output section 208 receives the search result from thesearch result generation section 207 and outputs the search result bydisplaying a character string or an image or playing back music, etc.

In the embodiment, for example, to output an image as shown in FIG. 11as the search result, “title,” “music genre,” “composer name,”“songwriter name,” and “URL where music data exists” are obtained usingthe CID from the data stored in the music-associated information storagesection 204 shown in FIG. 10 and image data is generated in the formatshown in FIG. 10 and is output to the display 102 of the mobiletelephone 101.

The ringer tone data is downloaded from URL 1 where the data exists fromthe music-associated information shown in FIG. 10 and is stored in thememory in the mobile telephone, and voice is output from the speaker 111connected to the mobile telephone 101.

In the description of the embodiment, search for ringer tone in themobile telephone is taken as an example, but the invention is notlimited to it. The invention can also be embodied as a music searchapparatus in an apparatus such as a mobile terminal or a CP that canplay back/download music.

At this time, if a search is made to play back music data in the mobileterminal, the rhythm data storage section 203 and the music data storagesection 201 are storage media such as memory in the mobile terminal, andthe similar rhythm search section 206 is implemented as a CPU and aprogram of the mobile terminal for playing back music data as output.

In the embodiment, the data of “title,” “music genre,” “composer name,”“songwriter name,” “URL where music data exists,” etc., is obtained withthe CID of the music identifier as a key. However, instead, the data of“title,” “music genre,” “composer name,” “songwriter name,” “URL wheremusic data exists,” etc., may be obtained with the ID (identifier) ofrhythm data as a key.

The search of the invention can also be used for the purpose of callingto play back a musical piece retained in the mobile telephone as thesearch result.

Only the time information (delta time) where sound rising information inthe selected track (note on message) occurs is cut out at (step S503).However, further sound falling information (note off message) may alsobe cut out and the sound rising information and the sound fallinginformation may be added together to the array as a numeric string. Inthis case, the rising time and the falling time are recorded alternatelyin the numeric array, and the data becomes time interval informationwith sound switched between ON and OFF. To use the rhythm data thuscreated, likewise, not only the time at which the OFF-to-ON statetransition is made, but also the time at which the ON-to-OFF statetransition is made is detected at the step where the input rhythm datais generated by the time-series signal input section 205 (step S701). Ifthe data is used, search can be conducted as in the embodiment describedabove. Accordingly, search making the most of not only the sound risingtiming, but also duration information can be conducted.

As described above, according to the invention, the music searchapparatus based on rhythm input can be made easier to use and easier toimplement.

Second Embodiment

Next, a second embodiment of the invention wherein search is made usingboth a terminal and a music search apparatus of a server will bediscussed.

The difference from the first embodiment will be discussed below:

In the second embodiment, the functions of the function blocks shown inFIG. 2 are installed in both a mobile telephone as of a music searchterminal and a music search apparatus as of a server. If the searchresult of a predetermined similarity degree is not provided in theterminal of the mobile telephone, etc., search is made using the musicsearch apparatus of the server.

Generally, the rhythm data storage section 203 in mobile telephone 101stores a subset of the data retained in a rhythm data storage section inthe music search apparatus of the server, and it is effective to storemusical pieces having a high possibility that the musical piece maybecome the search result. However, the rhythm data storage section 203is not limited to a subset and the rhythm data of the musical piecesretained by the user and the rhythm data keyed by the user are stored,whereby it is also possible to provide the search result unique to theuser.

FIG. 12 is a flowchart to describe the operation of the music searchapparatus. In the description that follows, for the functions in themobile telephone (music search apparatus), a suffix of T (Terminal) isadded to each reference numeral and for the functions in the musicsearch apparatus of the server, a suffix of S (Server) is added to eachreference numeral.

In FIG. 12, in the mobile telephone of the terminal (music searchapparatus), a time-series signal input section 205T receives atime-series signal with the passage of time and outputs the time-seriessignal to a similar rhythm search section 206T in the mobile telephone(step S1201). This can be executed in the mobile telephone as anapplication, such as i-appli (registered trademark in Japan), asfollows: For example, a program for detecting an event of a centerbutton being pressed and receiving an input time-series signal forms thetime-series signal input section 205T, and rhythm data previouslydefined as constant data is stored in a scratch pad of a data storagemechanism of the i-appli, thereby forming a rhythm data storage section203.

In the terminal, the similar rhythm search section 206T formed as ani-appli program, for example, in the mobile telephone references therhythm data storage section 203T in the mobile telephone and performssearch processing similar to that in the first embodiment (step S1202).

In the terminal, if the result of a predetermined similarity degree ormore is obtained at step S1202 (Yes at step S1203), a search resultgeneration section 207T uses music-associated information obtained froma music-associated information storage section 204T to generate thesearch result to be output as the final search result based on theobtained result (step S1204). The predetermined similarity degreementioned above can be determined 0.9, etc., in the similarity degreewith 1 as the maximum value.

In the terminal, if the result of a predetermined similarity degree ormore is not obtained at step S1202 (No at step S1203), the time-seriessignal as a search request is transmitted to the music search apparatusof the server (step S1205).

In the music search apparatus of the server, a rhythm data storagesection 203S is referenced and search processing is performed (stepS1251) and then the search result to be output as the final searchresult is generated using music-associated information obtained from amusic-associated information storage section 204S and is transmitted tothe mobile telephone terminal (step S1252) as in the first embodiment.In the music search apparatus of the server, if the search processing inthe terminal is not terminated (No at step S1253), the process returnsto step S1251.

In the terminal, the search result is received from the music searchapparatus of the server (step S1206).

In the terminal, the obtained search result is output to a display,etc., (step S1207).

In the terminal, to terminate the search processing, a search processingtermination notification is sent to the search apparatus via a radiocommunication line and the processing is terminated (step S128).

As described above, according to the invention, the music searchapparatus based on rhythm input can be made easier to use and easier toimplement.

Further, in the second embodiment, when the search result of thepredetermined similarity degree can be obtained in the mobile telephoneterminal, the search result can be obtained without delay caused bycommunications, etc., so that the search result can be obtained at highspeed and further when the search result of the predetermined similaritydegree cannot be obtained, the search result is provided by the musicsearch apparatus of the server, so that the search result considered tobe more correct can be obtained.

Generally, the server has a margin of the storage capacity as comparedwith the terminal and thus stores more rhythm data than the terminal.Although it is difficult to perform calculation of search, etc., aboutlarge-scaled data in the mobile telephone, as search is executed in themusic search apparatus of the server, the user can also obtain thesearch result for a musical piece whose rhythm data is not retainedalthough a delay is caused by communications, etc.

If the result of the predetermined similarity degree or more can befound in the mobile telephone, the user may be enabled to command themusic search apparatus of the server to conduct-search.

Third Embodiment

Next, a third embodiment of the invention will be discussed. In theembodiment, the search result is output involving the words, score,syllable names, and sound of the keying portion inputting an inputtime-series signal.

The difference from the first embodiment will be discussed below:

In the third embodiment, in the process of generating and outputting thesearch result, a part or all of words, a part or all of syllable namesof note of musical piece, a part or all of score, or voice audition datais played back so that the user can keep track of the portioncorresponding to an input time-series signal. Accordingly, if the userenters the rhythm pattern of an impressive phrase without knowing thename of a musical piece for searching for the musical piece and severalcandidates are displayed, it is made possible for the user to easilydetermine which candidate is his or her desired candidate.

The embodiment is implemented as follows:

In each piece of rhythm data stored in a rhythm data storage section203, a time stamp indicating the rhythm appears at a time position ofhow many seconds since the start of the musical piece containing therhythm is retained. Usually, one time stamp is registered, but two ormore time stamps can be registered. In a music-associated informationstorage section 204, the corresponding portions of words, syllablenames, score, voice data are registered by time stamp, whereby eachmusic-associated information can be related to each piece of rhythm datafor output. The output is generated as a part of the search result in asearch result generation section 207 and is output in a search resultoutput section 208, so that the user can rapidly determine whether ornot the search result is as intended according to the words and themusical scale of the portion corresponding to the input time-seriessignal.

In addition to the method of registering the data by time stamp, forexample, if the data is voice data, it is easy to cut out aseveral-second portion from the specified portion and output the cut-outportion according to a known art, and the voice audition datacorresponding to the input portion of the time-series signal by the usercan be provided.

The time of the start position for each reasonable portion of words,syllable names, score, etc., is previously tagged as associatedinformation, whereby some words, syllable names, score, etc., containingthe input range of the time-series signal by the user can be output.

Alternatively, an output mode wherein all words, syllable names, score,etc., are output and then the input range of the time-series signal bythe user is displayed in a different color, etc., rather than the outputmode of some words, syllable names, score, etc., is also effective.

As described above, according to the invention, the music searchapparatus based on rhythm input can be made easier to use and easier toimplement.

Fourth Embodiment

Next, a fourth embodiment of the invention will be discussed. In theembodiment, an input time-series signal at the search time is convertedinto rhythm data, which is then stored in a rhythm data storage sectionfor reuse for the later search.

The difference from the first embodiment will be discussed below:

In the fourth embodiment, the following mechanism is introduced: Aninput time-series signal at the search time is converted into rhythmdata, which is then stored in a rhythm data storage section 203 forreuse for the later search, thereby enhancing the search accuracy.

The portion wherein the search result of a similar rhythm search sectionbased on a signal received at a time-series signal input section isoutput in a search result output section is similar to that in the firstembodiment.

In the fourth embodiment, further the input time-series signal isconverted into the data format of rhythm data for retention in therhythm data storage section 203.

If the user selects one musical piece from the search result, theretained input time-series signal is converted into the data format ofrhythm data and is additionally registered in the rhythm data storagesection 203 as one piece of the rhythm data of the selected musicalpiece. The data format conversion may be executed according to a methodsimilar to the method previously described with reference to FIG. 8 inthe first embodiment.

Accordingly, the possibility that the candidate musical piece selectedthis time may be displayed as a higher-order candidate becomes high inresponse to a search request with a similar input time-series signal.This makes the most of the nature that the feature for each user isoften recognized although rhythm recognition and time-series signalinput of the user are not necessarily as the musical score. If the sameuser executes two or more searches for one musical piece, for example,if the user searches for the musical piece to call the musical pieceretained in the terminal, the accuracy is enhanced as compared with theusual case.

As described above, according to the invention, the music searchapparatus based on rhythm input can be made easier to use and easier toimplement.

Further, in the fourth embodiment, search with higher accuracy can beconducted.

The invention is not limited to the specific embodiment described aboveand various changes and modifications can be made without departing fromthe spirit and the scope of the invention.

An information edit apparatus of the invention can be implemented as aprogram operated in a computer such as a workstation (WS) or a personalcomputer (PC).

FIG. 13 is a block diagram to show a configuration example when aninformation edit apparatus (music search apparatus) according to theinvention is implemented in a computer. This computer includes a centralprocessing unit 1301 for executing a program, memory 1302 for storingthe program and data being processed by the program, a magnetic diskdrive 1303 for storing the program, the data to search for, and OS(Operating System), and an optical disk drive 1304 for reading/writingthe program and data from/to an optical disk.

The computer further includes an image output section 1305 of aninterface for displaying a screen on a display, etc., an inputacceptance section 1306 for accepting input from a keyboard, a mouse, atouch panel, etc., and an output/input section 1307 of an output/inputinterface with an external machine (for example, USB (Universal SerialBus), a voice output terminal, etc.,). The computer also includes adisplay 1308 such as an LCD, a CRT, or a projector, an input unit 1309such as a keyboard or a mouse, and an external machine 1310 such as amemory card reader or a speaker.

The central processing unit 1301 reads the program from the magneticdisk drive 1303 and stores the program in the memory 1302 and thenexecutes the program, thereby implementing the function blocks shown inFIG. 2. During the program execution, a part or all of the data tosearch for may be read from the magnetic disk drive 1303 and may bestored in the memory 1302.

As the basic operation, a search request made by the user is receivedthrough the input unit 1309 and a search is made for the data to searchfor stored in the magnetic disk drive 1303 or the memory 1302 inresponse to the search request. The search result is displayed on thedisplay 1308.

The search result not only is displayed on the display 1308, but alsomay be presented to the user by voice with a speaker connected to thecomputer as the external machine 1310, for example. Alternatively, thesearch result may be presented to the user as printed matter with aprinter connected to the computer as the external machine 1310.

It is to be understood that the invention is not limited to the specificembodiments described above and that the invention can be embodied withthe components modified without departing from the spirit and scope ofthe invention. The invention can be embodied in various forms accordingto appropriate combinations of the components disclosed in theembodiments described above. For example, some components may be deletedfrom all components shown in the embodiment. Further, the components indifferent embodiments may be used appropriately in combination.

As described with reference to the embodiments, there is provided amusic search apparatus including input means that inputs a time-seriessignal whose on state and off state are repeated alternately; datastorage means for storing a plurality of pieces of rhythm data inassociation with music-associated information associated with musiccorresponding to the rhythm data; search means for searching theplurality of pieces of rhythm data stored in the data storage means forrhythm data having the same fluctuation pattern as or a similarfluctuation pattern to the time-series signal input to the input means;and search result output means for reading the music-associatedinformation stored in association with the rhythm data found by thesearch means from the data storage means and outputting the readmusic-associated information as the search result of the search.

The invention relating to the apparatus also holds as the inventionrelating to a method and the invention relating to the method also holdsas the invention relating to the apparatus.

The invention relating to the apparatus or the method also holds as aprogram for causing a computer to execute a procedure corresponding tothe invention (or causing a computer to function as means correspondingto the invention or causing a computer to provide functionscorresponding to the invention) and also holds as a computer-readablerecord medium recording the program.

According to the invention, the music search apparatus for making itpossible to search for music containing a rhythm similar to the rhythmin response to rhythmical ON/OFF change input of a time-series signaland inspect the music information or play back music can be realized.

1.-19. (canceled)
 20. A computer-readable program product for causing acomputer system to execute procedures for searching a music, comprising:inputting a time-series signal represented by on/off signals; storing aplurality of pieces of rhythm data in association with music-associatedinformation associated with music corresponding to the rhythm data;searching the plurality of pieces of rhythm data for rhythm data havingthe same fluctuation pattern as or a similar fluctuation pattern to thetime-series signal; reading the music-associated information stored inassociation with the rhythm data found by the searching; outputting theread music-associated information as the search result of the search;determining whether or not rhythm data of a predetermined similaritydegree or more has been found as the result of the searching; anddisplaying the search result when rhythm data of the predeterminedsimilarity degree or more has been found as the result of thedetermining, and displaying the search result when rhythm data of thepredetermined similarity degree or more has not been found as the resultof the determining.
 21. A computer-readable program product for causinga computer system to execute procedures for searching a music,comprising: inputting a time-series signal represented by on/offsignals; storing a plurality of pieces of rhythm data in associationwith music-associated information associated with music corresponding tothe rhythm data; searching the plurality of pieces of rhythm data forrhythm data having the same fluctuation pattern as or a similarfluctuation pattern to the time-series signal; reading themusic-associated information found by the search; outputting the readmusic-associated information as the search result of the search;calculating excess or deficiency of input time of the time-seriessignal; and outputting the calculated excess or deficiency.
 22. Acomputer-readable program product according to claim 20, wherein theoutputting includes outputting the rhythm data found by the searching inaddition to the music-associated information as a search result of thesearching; and wherein the procedures for searching a music furtherinclude storing the rhythm data found by the searching.
 23. Acomputer-readable program product according to claim 20, wherein thestoring includes storing at least one item of music data of syllablenames, score, words, and music data as the information associated withmusic, and wherein the outputting includes outputting the informationassociated with music as a part of a search result of the searching.